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Abstract  —  When  positioning  a  number  of  static  or 
mobile  agents  (human  or  autonomous)  into  an  area  for 
the  purpose  of  surveillance,  the  positioning  and  motion 
strategies  assigned  to  these  agents  impact  on  the  situ¬ 
ation  awareness  gained.  This  paper  presents  a  toolbox 
that  evaluates  motion  and  placement  strategies  in  a  real¬ 
istic  surveillance  context,  using  the  Interpreted  Systems 
semantics.  Its  five  components  implement  relevant  the¬ 
oretical  concepts:  simulation  of  neutral  and  opposing 
forces’  behavior,  geometrical  discretization  of  the  Area 
of  Interest,  state  space  generation,  state  space  analysis, 
and  visualization. 

Keywords:  Situation  analysis,  situation  awareness, 
interpreted  systems,  visibility  graphs,  pursuit-evasion. 

1  Introduction1 

Situation  Awareness  is  essential  to  conduct  decision¬ 
making  activities.  It  is  about  the  perception  of  the  el¬ 
ements  in  the  environment,  the  comprehension  of  their 
meaning,  and  the  projection  of  their  status  in  the  near 
future  [2].  Situation  Analysis  (SA)  is  defined  as  a  pro¬ 
cess,  the  examination  of  a  situation,  its  elements,  and 
their  relations,  to  provide  and  maintain  a  product,  i.e. 

,  a  state  of  situation  awareness  for  the  decision  maker 
[3] .  This  follows  a  standard  intuition  about  levels  2  and 
3  of  the  standard  JDL  Information  Fusion  model  where, 
according  to  Steinberg  and  Bowman  [4]  Situation  As¬ 
sessment  (level  2)  is  the  “ estimation  and  prediction  of 
entity  states  on  the  basis  of  inferred  relations  among  en¬ 
tities ”  whereas  Impact  Assessment  (level  3)  “is  usually 
implemented  as  a  prediction,  drawing  particular  kinds 
of  inferences  from  Level  2  associations’ ’ . 

The  situation  analysis  process  has  to  evaluate  with 
both  knowledge  and  uncertainty.  A  formalization  is 
necessary  if  one  is  interested  in  the  reproducibility  of 

^his  paper  is  a  modified  version  of  what  has  been  presented 
in  [1].  Part  of  the  description  in  Section  2.2  have  been  also  used 
in  a  paper  by  Van  der  Meyden  et  al.  submitted  at  the  IJCAI 
2011  conference. 
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results,  complex  space-time  problem  solving,  and  in  a 
language  to  represent  and  reason  about  dynamic  situa¬ 
tions.  In  [5],  we  proposed  a  formal  model  for  situation 
analysis  based  on  the  interpreted  systems  semantics  [6] , 
a  framework  in  which  knowledge,  information  and  un¬ 
certainty  can  be  represented,  combined,  managed,  re¬ 
duced,  increased,  and  updated. 

The  general  problem  of  decision  support  can  be 
sparsed  into  two  principal  tasks:  situation  analysis  and 
planning.  These  two  tasks  are  not  easily  separable  since 
the  actions  carried  out  according  to  the  plan  defined 
during  the  task  of  planning  modify  the  state  of  the 
environment  and  of  the  agents.  This  modifies  the  in¬ 
formation  to  which  the  agents  have  access  (their  own 
or  collective  epistemic  state)  and  thus  their  situational 
awareness.  Our  approach  to  situation  analysis  consid¬ 
ers  that  the  situation  is  created  by  the  execution  of  a 
joint  protocol  for  the  agents  P  in  interaction  with  the 
environment’s  protocol  Pe,  the  latter  including  a  pos¬ 
sible  opponent.  The  interpreted  systems  semantics  will 
be  used  as  the  single  specification  language  for  both 
planning  and  situation  analysis  [7]. 

In  this  paper,  we  present  a  Situation  Analysis  Tool¬ 
box  (SAT),  which  implements  the  theoretical  concepts 
put  forth  in  our  previous  works  [8,  5,  7].  The  general 
idea  behind  this  toolbox  is  to  build  situations  and  anal¬ 
yse  them.  We  use  the  formalism  of  the  non-cooperative 
dynamic  game  theory  [9]  to  model  the  situation.  In  its 
most  general  form  it  consists  in  a  game  between  two 
teams  having  opposite  goals,  the  players  jointly  seeking 
to  maximize  (resp.  to  minimize)  a  function  of  distance 
between  targets.  Differential  game  theory  of  Isaacs  [10], 
dating  back  to  the  1960s,  made  it  possible  to  model  the 
pursuit-evasion  game  -  a  simplified  version  of  the  prob¬ 
lem  of  rendez-vous  [11].  Isaacs’  theory  can  be  used  to 
model  many  military  problems  by  combining  the  tra¬ 
ditional  game  theory  of  von  Neuman  and  Morgenstein 
[12]  (used  especially  in  economy),  variations  calculus, 
and  theory  of  optimal  control.  The  interest  to  use  such 
a  framework  for  modelling  the  situations  to  be  further 


analyzed  is  the  existence  of  some  analytically  derivable 
optimal  solutions,  thus  helping  to  measure  the  quality 
of  solutions  for  simple  cases.  Another  advantage  of  this 
theoretical  framework  is  its  great  flexibility.  Indeed,  by 
slightly  modifying  the  constraints  of  the  basic  game,  a 
large  range  of  situations  can  be  easily  modeled:  colli¬ 
sion  avoidance,  target  tracking,  or  stowing. 

SAT  consists  of  five  (5)  components  (sub-toolboxes): 
(1)  the  Discretization  Toolbox,  which  allows  an  abstrac¬ 
tion  of  a  continuous  environment  into  both  visibility 
and  navigation  graphs,  (2)  the  Behaviour  Simulation 
Toolbox,  which  enriches  the  environment  with  contain¬ 
ment  probability  maps,  (3)  the  State  Generation  Tool¬ 
box,  which  builds  a  transition  state  system  based  on 
joint  strategies  of  some  agents  constrained  by  the  con¬ 
text  defined  in  (1)  and  (2),  (4)  the  State  Searching 
Toolbox,  which  plays  the  role  of  a  model  checker  and 
temporal  logical  formulas  verification  in  the  transition 
state  system,  and  (5)  the  Visualization  Toolbox,  which 
renders  states  and  graphs  on  screen. 

The  paper  is  organised  as  follows.  Section  2  is  ded¬ 
icated  to  theoretical  background  including  formal  defi¬ 
nition  of  a  situation,  situation  awareness,  and  situation 
analysis  framed  into  the  interpreted  system  semantics, 
to  basics  of  pursuit-evasion  games.  This  background 
section,  also  describes  a  counter-smuggling  scenario  sit¬ 
uated  in  Howe  Sound  (on  Canada’s  West  Coast,  north¬ 
west  of  Vancouver)  on  which  the  SAT  will  be  illus¬ 
trated.  Section  3,  presents  the  Situation  Analysis  Tool¬ 
box  and  details  of  its  five  components  together  with 
their  related  theoretical  concepts.  Finally,  Section  4 
provides  further  potential  use  and  applications  of  the 
SAT. 

2  Theoretical  Background 

In  the  following  Section,  we  will  give  formal  definitions 
of  situations,  situation  awareness  and  situation  analy¬ 
sis  as  well  as  basics  on  visibility-based  pursuit-evasion 
games  that  will  be  used  to  model  the  situations. 

2.1  Interpreted  Systems  for  Situation 
Analysis 

The  interpreted  systems  semantics  has  been  intro¬ 
duced  in  [6]  and  proposed  in  [8,  5]  as  a  formal  language 
for  situation  analysis. 

Let  A  =  {1,  2,  3, . . . ,  n,  e }  be  a  set  of  agents,  where  e 
is  a  special  agent  denoting  the  environment.  Each  agent 
is  assumed  to  be  in  some  local  state  U  at  a  given  time, 
encapsulating  all  the  information  the  agent  has  access 
to.  le  encodes  all  the  relevant  information  that  is  not 
encoded  in  the  agents’  local  states.  In  particular,  le  can 
encode  the  objective  state  of  the  world,  which  is  usually 
not  attainable  by  the  agents’  perception  and  reasoning 
means.  For  SA  applications,  apart  from  the  objective 
states  of  the  world,  le  can  contain  maps  of  the  environ¬ 
ment,  network  information,  or  any  other  information 


describing  the  outside  world.  The  agents’  local  states 
can  encode  partial  or  imperfect  views  of  this  outside 
world. 

A  global  state  s  is  an  element  of  S  C  L\  x . . .  x  Ln  x  Pe, 
where  Li  is  the  set  of  all  possible  local  states  of  agent  i. 
A  sequence  of  global  states  s1,  s2, . . .  is  called  run  r  over 
S  and  can  be  viewed  as  a  function  from  time  to  global 
states.  A  system  P  is  a  set  of  runs,  and  (r,  m)  denotes 
a  point  in  7 Z.  If  r{m)  =  (Zi , . . .  Zn,  le)  is  the  global  state 
at  point  (r,  m)  (the  state  of  the  system  at  time  m  in 
run  r),  then  re(m)  =  le  and  77(771)  =  U.  A  round  m  in 
run  r  takes  place  between  time  m  —  1  and  time  m. 

Actions  are  the  cause  of  changes  in  the  system  and 
are  performed  by  the  agents  and  the  environment  in 
rounds.  Let  ACTi  be  the  set  of  actions  that  can  be 
performed  by  agent  i,  i  —  1, . . . ,  n  and  let  ACTe  be  the 
set  of  actions  performed  by  the  environment.  A  joint 
action  is  an  element  of  ACTe  x  ACTi  x  . . .  x  ACTn, 
i.e.  a  tuple  (ae,  ai, . . . ,  an)  of  actions  performed  by  the 
set  of  agents  and  the  environment.  A  denotes  the  null 
action. 

A  protocol  Pi  for  the  agent  i  is  a  mapping  from  the 
set  Li  of  local  states  of  the  agent  i  to  nonempty  sets  of 
actions  in  ACTi ,  i  G  A.  A  joint  protocol  P  is  a  tuple 
(Pi,  P2, . . . ,  Pn)  consisting  of  the  protocols  of  each  of 
the  agents  i,  i  =  1, . . . ,  n.  Note  that  Pe,  the  protocol  of 
the  environment,  is  not  included  in  the  joint  protocol, 
but  it  is  rather  a  part  of  the  context. 

A  context  7  is  a  tuple  (Pe,  P  ^)  where  Pe  is  a  pro¬ 
tocol  for  the  environment,  So  is  a  nonempty  subset  of 
S  describing  possible  states  of  the  system  at  the  ini¬ 
tiation  of  the  protocol,  r  is  a  transition  function,  and 
47  is  an  admissibility  condition  on  runs.  The  environ¬ 
ment’s  protocol  Pe  can  be  used  to  model  the  adversary’s 
strategies  or  simply  to  model  random  errors  or  events 
in  a  given  situation.  A  transition  function  r  assigns 
to  each  global  state  and  each  joint  action  the  resulting 
global  state  obtained  after  performing  the  joint  action. 
The  transition  function  describes  which  actions  can  be 
performed  from  a  given  global  state,  as  well  as  the  ef¬ 
fect  of  these  actions.  The  admissibility  condition  4>  on 
runs  tells  which  ones  are  “legal” .  In  practice,  T  can  be 
used  to  shrink  down  a  large  system,  or  to  model  fair¬ 
ness  conditions.  Formally,  47  is  a  set  of  runs  and  r  E  47 
if  and  only  if  r  satisfies  the  condition  47.  Note  that  the 
description  of  the  behaviour  of  a  system  is  contextual, 
i.e.  ,  a  joint  protocol  P  is  always  described  within  a 
given  context  7. 

Let  47  be  a  set  of  primitive  propositions,  describing 
basic  facts  about  the  system.  Formulas  are  built  us¬ 
ing  the  classical  operators  of  propositional  logic.  The 
set  of  formulas  is  closed  under  -1  and  A  (negation  and 
conjunction).  Hence,  given  two  formulas  0  and  0,  ->0, 
0  A  0  are  also  formulas.  Let  £(47)  denote  the  language 
of  47,  i.e.  the  set  of  well- formed  formulas. 

An  interpreted  system  (IS)  T  consists  of  a  pair  (P,  7 r) 
where  P  is  a  system  over  a  set  S  and  1 r  is  an  interpre- 


tation  for  the  propositions  in  <F  over  S',  which  assigns 
truth  values  (either  true  or  false)  to  the  primitive  propo¬ 
sitions  at  the  global  states.  Thus,  for  every  p  G  4>  and 
state  s  G  S,  we  have  tt (s)(p)  G  {/a/se;  true}. 

We  define  a  situation  in  terms  of  a  transition  state 
system  in  which  the  arcs  are  labeled  by  joint  actions 
and  nodes  by  global  states.  Formally,  let  A  be  a  set  of 
n  +  1  agents  including  the  environment,  and  let  X  be 
the  interpreted  system  representing  the  joint  protocol 
P  of  the  n  agents  in  the  interpreted  context  (7,  tt). 

Definition  2.1  (Situation  [5])  A  situation  is  the 

sub- system  Z(r?m)  of  X ,  that  is  the  system  representing 
P  in  the  interpreted  context  (7 (r?m) ,  tt)  where  7(r?m)  = 
((r, 

Situation  analysis  is  the  process  by  which  the  decision 
maker  (or  analyst)  reaches  a  state  of  situation  aware¬ 
ness  which  will  then  allow  him  (or  her)  to  make  deci¬ 
sions. 

Definition  2.2  (Situation  analysis  [5])  Situation 

analysis  is  the  process  of  verifying  properties  of  X.  If 
<p  is  a  formula  of  expressing  such  a  property, 

then  analysing  the  situation  amounts  to  answering  the 
question 

(X,  r,m)\=  cf>  (1) 

If  <fi  is  satisfied  in  X  at  (r,m),  then  the  analyst  of  the 
system  is  said  to  be  aware  of  <fi. 

If  the  verification  algorithm  ( e.g .  model  checking)  is 
sound  (i.e.  always  gives  correct  answers),  then  the  an¬ 
alyst  has  explicit  knowledge  of  (see  [5]  for  details). 

Epistemic  model  checking  is  used  as  a  technique  for 
(1)  studying  the  consequences  of  the  joint  execution  of 
protocols  on  the  mental  states  of  the  agents,  (2)  data 
mining  allowing  to  analyze  in  a  qualitative  way  the  state 
transition  systems  thus  obtained,  and  possibly  (3)  al¬ 
lowing  to  check  the  existence  of  certain  equilibrium  con¬ 
ditions  of  games  in  terms  of  epistemic  group  notions. 

Awareness  however,  is  not  simply  a  special  state  of 
knowledge  but  also  refers  to  a  limited  capacity  of  the 
agents.  Considering  the  limited  resources  of  agents,  we 
proposed  in  [5]  a  definition  of  awareness  inspired  by  [13] 
and  [14]: 

Definition  2.3  (Awareness  [5])  The  local  state  of 
each  agent  i  at  point  (r,  m)  includes  both  a  local  al¬ 
gorithm  Aw i  =  alg i(r,m)  and  local  data  li  =  obs i(r,m). 
An  agent  i  of  A  is  aware  of  <fi  at  a  given  point  (r,  m) 
in  X,  which  we  denote  by  Aif),  iff  it  is  able  to  compute 
the  truth  value  of 

(X,r,m)  \=Ai(/>  iff  A^h)^  (2) 

The  interpretation  of  A{  is  thus  understood  as  captur¬ 
ing  any  constraints  like  time,  memory,  reasoning  abili¬ 
ties,  etc. 


Definition  2.4  (Situation  awareness  [5])  For  an 

agent  i  of  A,  the  situation  awareness  at  point  (r,  m)  is 
the  set  of  formulas  0/ £(<£>)  about  which  the  agent  i  is 
aware: 

A\Ni(r,m)  =  {<f>  G  £(4>)|(X,  r,  m)  1=  Ai<j)}  (3) 

Situation  awareness  is  thus  defined  in  terms  of  states, 
i.e.  ,  in  terms  of  a  set  of  points  in  the  system.  For  a 
given  agent,  the  situation  awareness  is  provided  by  test 
evaluations  on  observations  about  the  environment  (the 
objective  state  of  the  world).  Situation  awareness  is 
both  an  epistemic  ability  and  a  precondition  for  action 
[7].  This  is  a  practical  definition  of  knowledge. 

2.2  Situations  generated  by  motion  and 
sensing  strategies 

The  games  studied  in  this  paper  are  special  cases  of 
motion  and  sensing  problems,  which  [15]  groups  into 
four  categories:  sensor  assignment,  sensor  placement, 
exploration,  and  pursuit-evasion.  These  four  problems 
can  be  seen  as  special  cases  of  a  more  general  problem, 
involving  either  single  or  multiple  sensors,  static  or  mo¬ 
bile  sensors,  a  searched  target  that  is  either  punctual 
or  distributed  across  the  environment.  The  examples 
illustrating  the  functionalities  of  the  SAT  toolbox  deal 
primarily  with  the  resolution  of  pursuit-evasion  (PE) 
games  and  sensor  placement  (SP),  although  we  believe 
that  the  problems  of  exploration  and  sensor  assignment 
can  also  be  studied  without  or  with  minor  modifications 
to  the  existing  toolbox. 

From  a  formal  point  of  view,  the  simplest  version 
of  the  sensor  placement  problem  can  be  seen  as  a  mo¬ 
tion  and  sensing  problem  involving  multiple  and  static 
agents  aiming  at  maximizing  their  sensing  coverage  of  a 
given  surface  of  interest.  A  joint  objective  for  the  mod¬ 
eler  is  most  of  the  time  is  also  to  minimize  the  number 
of  sensors  used.  On  the  other  hand,  in  the  simplest 
pursuit-evasion  problem  the  aim  will  be  for  a  pursuer 
to  minimize  the  distance  to  an  evader,  and  vice-versa. 

Problem  solving  situations  such  as  pursuit-evasion 
are  quite  common,  and  come  in  various  flavors.  Also, 
depending  on  the  scientific  community  many  synonyms 
are  used  to  designate  somewhat  similar  problems:  art 
gallery  problems  in  computational  geometry  [16,  17], 
graph  searching  in  computer  science  [18,  19]  and  [20], 
rendezvous  problems  in  operations  research  [21,  22]  and 
[23],  and  differential  games  in  control  theory  [24]. 

A  rough  classification  of  pursuit  evasion  problems 
is  based  of  the  following  variables:  whether  the  en¬ 
vironment  is  continuous  or  discrete,  the  pursuit  suc¬ 
cess  criterion  is  of  kind  (being  caught  or  not)  or  of 
degree  (getting  close  to  evader  for  more  than  n  sec¬ 
onds),  involving  a  single  pursuer  (evaders)  or  multiple 
pursuers  (evaders).  Other  agent-related  variables  dis¬ 
tinguishing  the  pursuit-evasion  problems  involve  sens¬ 
ing  (whether  agents’  visibility  is  limited  or  not,  un¬ 
certain  or  not),  knowledge  (whether  the  agents  are 


aware  of  the  environment’s  map,  of  their  own  or  other 
agents’  position,  whether  there  is  or  not  an  evader  or 
pursuer  in  the  environment),  communication  (whether 
multiple  pursuer  can  communicate  and  thus  coordi¬ 
nate  the  actions),  steering  ability  (unequal  agility  for 
pursuers  and  evaders),  motion  capability  (locally  con¬ 
strained,  or  jumping  to  other  positions  instantly),  mem¬ 
ory  (whether  the  agents  remember  their  past  moves). 

Local  states  encode  physical  terrain  positions  and 
hence  the  possible  states  of  the  agents  can  be  stacked 
up  the  map,  allowing  convenient  illustrations  (see  for 
example  Figure  4(b)). 

2.3  Counter-smuggling  Vignette 

We  illustrate  the  SAT  on  a  counter-smuggling  vignette 
shown  in  Figure  1.  In  this  figure,  several  boats  manned 
by  smugglers  (the  hostile  agents)  operate  in  Howe 
Sound  (close  to  Vancouver).  They  attempt  to  go  from 
their  hiding  places  to  target  locations  where  their  illegal 
goods  can  be  exchanged.  These  agents  try  to  avoid  ob¬ 
stacles  such  as  islands,  and  avoid  colliding  with  each 
other.  They  also  try  to  keep  a  distance  away  from 
the  neutral  agents  such  as  ferries  and  pleasure  crafts 
to  avoid  being  seen  and  perhaps  cause  suspicion.  More 


Figure  1:  A  smuggling  operation  has  been  reported 
in  Howe  Sound  (north-west  of  Vancouver  on  Canada’s 
West  Coast).  Can  we  guarantee  that  the  smugglers  will 
be  detected  ? 

specifically,  the  neutral  agents  can  be  ferries  or  ships 
that  follow  a  specific  route,  or  boats  that  sail  in  any 
random  direction.  The  locations  of  the  home  and  tar¬ 
get  harbours  are  determined  probabilistically. 


3  Situation  Analysis  Toolbox 

The  SAT  software  is  intended  to  provide  tools  for  gener¬ 
ating  situations  as  well  as  analysing  them.  A  key  com¬ 
ponent  of  a  situation  is  its  context,  which  will  be  mainly 
represented  here  by  the  terrain  on  which  the  situation 
takes  place.  The  area  of  interest  is  represented  in  the 
form  of  a  polygon  (z.e.  boundary  of  the  search  area) 
with  holes  (which  represent  obstacles  that  the  agents 
can  neither  see  nor  pass  through).  The  software  is  di¬ 
vided  into  five  sub-toolboxes,  which  serve  different  func¬ 
tions:  (1)  Discretization  Toolbox,  (2)  State  Generation 
Toolbox,  (3)  State  Searching  Toolbox,  (4)  Behaviour 
Simulation  Toolbox  and  (5)  Visualization  Toolbox. 

The  high-level  data  flow  diagram  given  in  Figure  2 
shows  how  these  components  are  connected:  First,  the 


Figure  2:  The  Situation  Analysis  Toolbox. 

Discretization  Toolbox  provides  an  abstraction  of  the 
terrain  into  a  visibility  graph  and  a  navigation  graph, 
which  will  then  serve  as  the  basis  for  defining  a  part  of 
the  context  7  and  the  set  of  possible  global  states  S  for 
the  system.  Another  component  of  the  context  comes 
from  the  Behaviour  Simulation  Toolbox,  which  provides 
agent  containment  probability  maps  of  the  area  under 
consideration.  The  State  Generation  Toolbox  inputs 
both  the  context  7  =  (Pe,  So,  r,  T)  and  the  strategies  of 
the  agents  P  =  [Pi, ... ,  Pn]  and  outputs  a  set  of  possi¬ 
ble  states.  The  situation  thus  built  (z.e.  ,  the  transition 
state  system)  can  then  be  analysed  through  the  State 
Searching  Toolbox,  whose  purpose  is  to  answer  logical 
queries  of  interest.  The  Visualization  Toolbox  provides 


graphical  user  interface  for  the  SAT. 

3.1  The  Discretization  Toolbox 

The  main  task  of  the  Discretization  Toolbox  is  to 
provide  discrete  representations  of  the  real-world  con¬ 
tinuous  search  space  geometry,  suitable  for  situation 
analysis  in  the  context  of  surveillance  problems.  The 
toolbox  supports  discrete  representations  in  the  form  of 
either  convex  polygons  (cells)  as  shown  for  instance  in 
Figures  5(a)  and  5(b),  or  points  as  shown  in  Fig.  3(b). 
Two  main  graphs  are  computed  by  the  Discretization 
Toolbox:  a  visibility  graph  and  a  navigation  graph. 


(a)  Simple  example  of  a  polyg-  (b)  Corresponding  visibility 
onal  environment  with  two  graph  over  the  set  of  reflex 
holes  (obstacles).  vertices. 


Figure  3:  Visibility  graph  computed  for  a  polygonal 
environment. 


with  unlimited  range  sen¬ 
sors  cover  Howe  Sound. 
Lines  show  visibility  be¬ 
tween  guards. 

Figure  4:  GIS  map  and  associated  visibility  graph. 

The  visibility  graph  of  a  set  of  points  Q  in  a  polygo¬ 
nal  environment  is  a  graph  Qv{Q)  whose  nodes  are  the 
points  in  Q  and  in  which  two  vertices  are  adjacent  if 
they  are  visible  from  each  other  in  the  environment. 
An  example  is  shown  in  Figure  3  for  the  reflex  ver¬ 
tices  in  a  simple  polygonal  environment,  and  in  Figure  4 


for  the  counter-smuggling  scenario.  The  Discretization 
Toolbox  provides  several  options  for  selecting  the  set  Q 
from  among  the  points  in  the  polygonal  environment. 
The  navigation  graph  Qn  defines  the  transition  function 
r  for  the  agents.  In  an  agent’s  navigation  graph,  the 
vertices  are  either  points  or  cells,  and  two  cells/points 
are  connected  if  an  agent  can  move  directly  from  the 
one  to  the  other  in  one  time  step.  As  a  rule,  the  nav¬ 
igation  graph  is  a  subgraph  of  the  visualization  graph 
as  two  adjacent  points/cells  are  always  visible  from  one 
another.  The  agent’s  knowledge  of  the  environment  is 
built  through  an  exploration  algorithm  whose  aim  is  to 
learn  the  environment  while  exploring  the  navigation 
graph.  Several  algorithms  such  as  the  one  described  in 
[25]  are  available. 

3.1.1  Sensor  placement  and  different  visibility 
ranges 

Figures  6  show  two  sensor  placement  solutions  to¬ 
gether  with  the  two  corresponding  discretizations  of 
the  environment.  Figures  5(a)  and  6(a)  correspond  to 
a  visibility  range  of  1km,  while  Figures  5(b)  and  6(b) 


(a)  Decomposition  obtained  (b)  Decomposition  obtained 
for  a  visibility  range  of  1000  for  a  visibility  range  of  2000 
meters.  meters. 


Figure  5:  Cell  decomposition  of  the  environment  for 
two  visibility  ranges. 

correspond  to  a  visibility  range  of  2km.  In  these  fig¬ 
ures,  all  the  islands  (obstacles)  are  retained  in  the  map. 
The  initial  Howe  Sound  map  has  been  simplified  using 
a  simplification  parameter  of  1000m,  meaning  that  all 
the  lines  smaller  than  1000m  are  removed.  The  simpli¬ 
fication  is  used  because  the  algorithm  for  positioning 
sensors  with  limited  visibility  range  generates  a  search 
space  decomposition  as  its  initial  step  and  decomposi¬ 
tion  can  be  computationally  expensive. 

Decreased  sensor  visibility  range  or  deteriorating 
weather  conditions  may  cause  the  increase  in  the  num¬ 
ber  of  sensors  needed  to  monitor  the  area.  Table  1  gives 


(a)  Sensor  placement  solu-  (b)  Sensor  placement  solu¬ 
tion  with  visibility  range  of  tion  with  visibility  range  of 
1000  meters  over  a  map  sim-  2000  meters  over  a  map  sim¬ 
plified  with  a  parameter  of  plified  with  a  parameter  of 
1000  meters.  1000  meters. 

Figure  6:  Sensor  placement  solutions  and  correspond¬ 
ing  visibility  graphs  for  different  visibility  ranges. 

indications  on  the  number  of  sensors  required  when  the 
visibility  range  changes  from  5km  to  1km.  The  sen¬ 
sors  are  positioned  until  the  100%  coverage  is  achieved. 
The  provided  running  times  are  obtained  by  running 


Visibility 

range 

Potential 
sensor  loca¬ 
tions 

Sensor  place¬ 
ment 

Running 

time 

Unlimited 

75 

13 

0:03.14 

5000m 

386 

27 

0:16.92 

4000m 

389 

33 

0:25.68 

3000m 

395 

57 

3:05.70 

2000m 

444 

114 

5:12.23 

1000m 

774 

378 

lh 

10:26.39 

Table  1:  Sensor  placement  for  different  visibility  ranges. 

the  experiments  on  IBM  ThinkPad,  with  Intel  Core  2 
Duo  CPU  T9600  at  2.80GHz,  and  1.98GB  RAM. 

3.1.2  Sensor  placement  and  critical  locations 
for  PE  games 

Different  map  sizes  and  corresponding  number  of  sen¬ 
sors  and  critical  locations  for  cooperative  guards  in  a 
PE  games  are  tested  on  the  same  map  (Howe  Sound) 
with  different  simplification  parameters  and  the  results 
are  shown  in  Table  2.  As  above,  the  sensors  are  placed 
until  reaching  a  coverage  of  100%.  The  “Sensor  place¬ 
ment”  column  represents  the  number  of  sensors  that  are 
required  to  cover  the  entire  search  polygon  (100%)  in 
the  case  of  unlimited  visibility  range  sensors  (visibility 
is  obstructed  by  obstacles  (islands)  only).  For  such  a 


sensor  placement,  the  art  gallery  algorithms  have  been 
used.  The  “PE  game:  critical  loc.”  column  represents 
the  number  of  critical  locations  that  needs  to  be  vis¬ 
ited  by  pursuer(s)  in  order  to  find  an  evader.  These 
locations  represent  the  locations  of  cooperative  guards. 
Cooperative  guards  cover  entire  search  polygon  and  the 
visibility  graph  whose  nodes  are  cooperative  guard  lo¬ 
cations  is  connected.  The  set  of  cooperative  guards  is 
used  for  the  PE  game  because  (i)  the  pursuers  can  move 
between  the  critical  locations  in  straight  lines  and  (ii) 
pursuers  are  able  to  visit  all  the  locations  (clear  the  en¬ 
tire  search  polygon)  by  walking  along  the  edges  of  the 
visibility  graph.  We  observe  that  the  larger  the  simpli¬ 
fication  parameter  is,  the  smaller  number  of  vertices  of 
the  search  space  will  be. 

3.2  The  State  Generator 

The  State  Generation  Toolbox  strives  to  be  an  imple¬ 
mentation  of  the  concepts  and  abstractions  introduced 
in  the  first  part  of  this  paper.  It  incorporates  the  con¬ 
cepts  of  state,  agent,  action,  transition  function,  and 
strategy.  It  provides  a  state  graph  which  represents  an 
interpreted  system  X  for  the  purpose  of  testing  agent 
behaviour  strategies.  This  module  takes  as  main  inputs 


Figure  7:  Display  of  the  state  space. 

the  abstraction  of  the  terrain  under  the  form  of  both  the 
visibility  and  navigation  graphs  computed  by  the  Dis¬ 
cretization  Toolbox.  Other  inputs  are:  the  agents’  local 
states  definition  ^  which  may  include  other  parameters 
than  the  positions,  the  agents’s  protocols  the  con¬ 
text  7  =  (Pe,  So,  t,  \k)  and  the  interpretation  function 
7 r  which  indicates  whether  some  Boolean  formulas  </> 
are  true  in  global  states  s.  Given  a  state,  the  State 


Table  2:  Number  of  sensors  and  critical  locations  for  a  PE  game  with  cooperative  guards  with  different  map 
simplifications. 


Decomp, 
range  (m) 

Vertices 

Reflex 

vertices 

Sensor 

place¬ 

ment 

Running 

time 

PE  games: 
Critical  loc. 

Running 

time 

As  is 

537 

316 

22 

6:15.57 

23 

8:57.42 

10 

473 

284 

22 

3:48.36 

24 

5:58.87 

50 

333 

212 

20 

1:35.26 

22 

2:59.12 

100 

253 

166 

18 

0:33.52 

20 

1:17.26 

250 

145 

99 

15 

0:09.14 

17 

0:12.65 

500 

97 

71 

14 

0:05:27 

15 

0:06.99 

1000 

75 

62 

13 

0:03.14 

15 

0:04.24 

2000 

67 

57 

12 

0:02.74 

12 

0:03.64 

Generation  Toolbox  outputs  a  set  of  successor  states. 
Figure  7  is  a  display  of  the  state  space  corresponding  to 
a  search  in  a  PE  game.  Circles  represent  global  states 
and  are  colored  in  green  according  the  proportion  of 
cleared  cells:  A  black  circle  means  that  no  state  has 
been  cleared  while  a  full  green  circle  means  that  all  the 
states  have  been  cleared.  The  red  circle  identifies  the 
current  state. 

3.3  The  State  Searching  Toolbox 

The  main  task  of  the  State  Searching  Toolbox  is  to 
provide  answers  to  formal  queries  by  searching  the  state 
graph  X.  This  module  takes  as  input  the  state  transi¬ 
tion  function  r  and  a  query  0,  and  outputs  the  query 
result.  Although  basic  answers  to  queries  on  state  tran¬ 
sition  systems  are  Boolean  (either  true  or  false),  de¬ 
grees  can  also  be  computed  ranging  from  probably  true 


EX  EX  EX  glob alS  t  a  t  e  AllC  le  ar| 

Clear  |  |  Close  ] 

Figure  8:  CTL  query  Graphical  User  Interface. 


AX  0 

(j)  in  all  next  states. 

EX  4> 

0  in  at  least  one  next  state. 

A  {(j)  U  %!)\ 

on  all  paths,  0  until 

E  [0  U  ij)\ 

on  at  least  one  path,  (f>  until  '0. 

AF  0 

On  all  paths,  in  some  future  state,  (f> . 

EF  0 

On  at  least  one  path,  in  some  future  state,  0. 

AG  0 

On  all  paths,  in  all  future  states,  0. 

EG  4> 

On  at  least  one  path,  in  all  future  states,  (j) . 

Table  3:  CTL  operators. 


to  probably  false.  Also,  additional  statistical  measures 
can  be  computed  such  as:  Number  of  states  where  </> 
is  true/false,  Number  of  paths  where  0  is  true/false, 
Length  of  path  where  (j)  is  true/false,  Length  of  path 
before  encountering  a  counterexample,  Average  length 
of  path,  Ratio  of  states/paths.  The  formal  language 
of  queries  is  CTL,  which  is  propositional  logic  over  the 
states  in  a  state  graph,  augmented  by  the  list  of  oper¬ 
ators  shown  in  Table  3. 

The  State  Searching  Toolbox  plays  the  role  of  a 
model  checker  and  thus  serves  as  the  situation  anal¬ 
ysis  tool  proper.  Figure  9  shows  an  instance  of  the 
counter-smuggling  vignette.  The  previously  computed 


restricted  search  space  is  discretized  into  cells,  of  which 
the  green  cells  are  used  to  compute  the  visibility  graph. 
In  a  first  step,  (both  the  purple  and  green)  cells  have 
been  selected  through  a  threshold  on  the  probability 
map  (see  for  example  Fig.  11(b)).  In  a  second  step, 
a  subset  of  the  thresholded  cells  is  further  selected 
and  colored  green.  The  green  cells  are  sufficient  to 
cover  all  thresholded  cells  using  infinite-range  omni¬ 
directional  sensors.  The  green  guy  marks  the  start 
position  of  the  pursuer,  who  is  supposed  to  systemat¬ 
ically  search  for  evaders  in  the  gallery.  The  predicate 
pursuitStateAUClear  used  in  the  query  ascertains 
that  (all  cells  in)  a  given  state  is  (are)  clear  of  evaders — 
or  equivalently,  that  any  evader  present  in  the  search 
area  has  been  caught.  The  results  of  past  CTL  queries 
are  shown  on  the  right-hand-side  of  the  screen.  In  this 
case,  they  return  false  because  the  topology  of  the  area 
allows  an  evader  to  hide  behind  islands  and  avoid  de¬ 
tection,  no  matter  how  the  pursuer  moves.  Multiple 
pursuers  would  be  necessary  to  completely  sweep  the 
area  and  guarantee  detection. 


Figure  9:  Executing  queries  using  the  Visualizer  Tool¬ 
box  for  the  counter-smuggling  vignette. 


(a)  Probability  map  of 
evader  presence.  Lighter, 
greenish  colours  represent 
higher  probability. 


(b)  Restricted  search 
space:  0.1  probability 

threshold. 


Figure  11:  Probability  map  output  by  the  Behaviour 
Simulation  Toolbox. 


3.4  The  Behaviour  Simulation  Toolbox 

The  main  task  of  the  Behaviour  Simulation  Toolbox 
(see  Figure  10)  is  to  extract  probability  maps  for  agent 
containment  from  OpenSteer2  multi- agent  simulations. 
The  OpenSteer  is  a  library  implementing  “steering  be¬ 
haviours”  originally  designed  by  Craig  Reynolds  [26] 
to  model  coordinated  motion  of  animals  such  as  flying 
birds.  Given  the  description  of  the  scenario  in  Section 


Figure  10:  Screen  shot  of  the  Behaviour  Simulation 
Toolbox  for  the  counter-smuggling  vignette. 

2.3,  the  Behaviour  Simulation  Toolbox  allows  the  gen¬ 
eration  of  a  map  of  the  most  likely  locations  for  finding 
the  smugglers.  The  main  input  to  the  Behaviour  Simu¬ 

2http : / / opensteer . sourcef orge . net 


lation  Toolbox  is  a  GIS  map  corresponding  to  the  area 
of  interest.  The  output  is  a  probability  map,  i.e.  a  set 
of  polygonal  cells  marked  up  with  their  probability  of 
agent  containment  (Fig.  11). 

3.5  The  Visualization  Toolbox 

The  Visualization  Toolbox  allows  the  user  to  run  and 
visualize  the  following:  discretization  of  a  map  into  ei¬ 
ther  cells  or  points  (guards)  (Figure  4(b)),  input  of  CTL 
queries  for  the  state  search,  display  of  the  results  of  the 
query,  and  visualization  of  the  graph  search  (Figure  9). 

The  state  generator  and  the  visualizer  currently  sup¬ 
port  the  following  problem  types  [27]:  the  pursuit-and- 
evade  problem,  the  sensor  placement  problem,  and  the 
exploration  problem. 

4  Conclusions 

We  presented  a  Situation  Analysis  Toolbox  implement¬ 
ing  formal  notions  of  situation  analysis  based  on  epis- 
temic  transition  state  systems.  Composed  of  5  sub¬ 
toolboxes,  the  SAT  builds  a  situation  based  on  an  ab¬ 
stract  version  of  the  environment  as  a  visibility  graph 
and  on  the  execution  by  a  set  of  agents  of  a  joint  strat¬ 
egy  derived  from  pursuit-evasion  game  theory.  The 
context  is  further  enriched  with  probability  maps  of 
presence  of  agents,  built  through  modeling  emerging 
behaviour.  Using  the  situational  definitions  and  for¬ 
malisms,  SAT  affords  modeling,  evaluation,  and  repre¬ 
sentation  of  dynamic  environments 
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Outline 


1 .  Formalisation  of  the  Situation  Analysis  process 

-  Situation,  Situation  awareness,  Situation  analysis 

2.  Situation  Analysis  Toolbox  (SAT)  implementing 
the  previous  theoretical  concepts 

-  Modeling  situation  as  a  pursuit-evasion  game 

-  Counter-smuggling  vignette 


Conclusions 


Five  Modules 

1)  Behaviour  simulation  toolbox 

2)  Discretisation  toolbox 

3)  State  generation  toolbox 

4)  State  searching  toolbox 

5)  Visualization  toolbox 
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Interpreted  Systems  Semantics  for  situation 
analysis 


Interpreted  systems  semantics  is  an  epistemic  logical  approach 
proposed  in  the  1995  for  the  analysis  of  distributed  systems  by  Fagin, 
Halpern,  Moses  and  Vardi 


R.  Fagin,  J.  Y.  Halpern,  Y.  Moses,  and  M.  Y.  Vardi.  Reasoning  about  knowledge.  The  MIT  Press,  Cambridge, 


Interpreted  Systems  Semantics  for  situation 
analysis 


Hypothesis:  Interpreted  Systems  Semantics  is  a  general  framework  for  situation 
analysis  and  high-level  information  fusion  applications 

Arguments: 

-  Designed  for  distributed  systems  analysis; 

-  Situations  are  adequately  represented  by  state  transition  systems; 


The  notions  of  Situation,  Situation  Awareness  and  Situation  Analysis  can  be 

formally  defined; 


-  Allows  reasoning  about  knowledge,  uncertainty  and  time; 

-  The  framework  is  general  enough  so  that  Generalized  Information  Theory 
can  be  framed  into  ISS; 


Can  take  advantage  of  both  model  checking  and  inductive  decision 

procedures. 


P.  Maupin  and  A.-L.  Jousselme.  A  general  algebraic  framework  for  situation  analysis.  In  Proc.  of  the  8th  Int. 
Conf.  on  Information  Fusion,  Philadelphia,  PA,  USA,  July  2005. 


RL>  Elements  of  the  model  (1) 

L^- 


Protocol  P, 


, Agenfx 


Observations  from  the  environment 
Probability  measures 
Algorithms  for  truth  evaluation 


/ 

7 

Actions 

ACTk 

7 

4CTm/ 

Agent  m 


Environment 
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Elements  of  the  model  (2) 


rV 


r\L> 


Joint  protocol  P 

p=(px,...,p,^ 


Global 

state 

^  (7l>  •  •  •  >  hr 


Joint  action 
a  =  (al,...,awa^ 


Context 

f=(50,r,Pc,Y) 


System 


i  =  (s,  p,  7,  < 


7T  is  an  interpretation  function  for  formulas  in  X(O) 
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Situation 


A  situation  is  the  subsystem  of  Jf  that  is  the  system 

representing  P  in  the  interpreted  context  (y^m),7i) 


3  remarkable  cases: 

1 .  Global  state 

2.  Given  a  single  initial  state 

3.  Full  spectrum  of  possible  paths 


State 


Actio 


State 


defense 


eience  R&D  Canada 


R  &  D  pour  la 


Canada 


Initial  states 


Awareness  as  resource-boundedness 


An  agent  is  aware  of  a  formula  (f>  if  it  is  able  to  compute  its 
truth  value 


(X,  r,  m)  1=  Ai<p  iff 


Algorithm  for  truth  evaluation 

A  i  =  alg  ;(r,  m) 


Local  data  =  Observations 

li  =  obs  i(r,  m) 


with  Ai  (0,  )  =  Yes  if  ^  is  true 

^No  if  (j)  is  false 

?  if  the  agent  is  unable  to  compute 


->The  fact  that  the  algorithm  can  compute  the  truth  value  of  ^ 
does  not  mean  that  this  is  the  correct  truth  value. 

->  Awareness  is  a  practical  notion  of  knowledge 
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Situation  analysis  (proposed  approach) 


Situation  analysis  is  the  process  of  verifying  properties  of  the 
interpreted  system  expressed  by  a  formula  <f>KT 

(1.  r.  m)  1=  0kt 


Queries 

Is  (j)  true  ? 

Will  (p  be  true  at  all  future  steps  ? 

Is  (J)  always  true  ? 

Does  Agent  1  knows  ^  ? 

Does  everybody  in  group  G  knows  $  ? 


Situation 


YES 
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r $y  Engineer  view  of  Interpreted  Systems 


SAT  -  A  Situation  Analysis  Toolbox 


■V 


Ri> 


OpenSteer 

commands 


5  modules 


1 

r 

Behaviour 

Too 

Simulation 

Ibox 

\ 

r 

Probability  maps  (eg.  likely  agent 
locations)  can  be  used  to  exclude 
areas  of  low  probability  from 
visibility  and  navigation  graphs 


Probability  Maps  y - 


Continuous  World 


SAT  Analyzer 


Discrete  Yvbrid: 
spatial  relationships 
between  objects  of 
interest  that  are 
taken  for  granted  in 
subsequent  analysis 


r 

Discretization  Toolbox 

"s 

s 

.rf- 

The  wider  context  includes  the 
state  and  action  definition ,  the  state 
transition  function ,  the 
interpretation,  the  initial  state  ,  and 
the  behaviour  of  the  environment 


Constraints  on  the  agents' 
mobility  (and  possibly  sensing 
and  communication)  that  the 
agents  can  control. 


f  Probability  Maps 


Probability  maps  can  be 
used  to  specify  absolute 
and  initial  probabilities. 


0 


All  that  is  known  about 
the  world 


Strategy 

Designer 


Visualizes  discretization 
and  state  search  results 


Question 


State  Searching  Toolbox 


Visualization  T  oolbox 


R*y  SAT  -  A  Situation  Analysis  Toolbox 


2  purposes: 

1 .  Situation  generation 

2.  Situation  analysis 
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•  Pursuer  and  evader  agents  are  constrained  to  move  within  a 
graph  whose  nodes  are  possible  locations  and  whose  edges 
denote  paths  between  two  locations. 

•  PE  consists  in  a  game  between  two  teams  having  opposite 
goals,  the  players  jointly  seeking  to  maximize  (resp.  to 
minimize)  a  function  of  distance. 

•  Each  agent  has  a  visibility  sensor  of  sensing  range  r  meaning 
that  the  agent  can  see  a  node  if  it  is  within  its  range. 


•  Capture  occurs  when  a  pursuer  and  the  evader  are  at  the  same 
position  (node)  at  the  same  time. 

•  Basic  action:  Move  from  one  node  to  an  adjacent  node. 

The  evader's  strategy  Pe  is  unknown  to  the  pursuers. 
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Counter-smuggling  vignette 


Neutral  agents  following 
ferry  and  ship  routes 


MAP  OF  HOWE  SOUND 

Hostile  Agent 
Neutral  Agent 
Movement  of  Hostile  Agent 
Movement  of  Neutral  Agent 
Harbour 


Probabilistic  start  positions  for 
the  hostile  agents 


A  smuggling  operation  has  been 
reported  in  Howe  Sound  (north-west 
of  Vancouver  on  Canada’s  West 
Coast). 

Can  we  guarantee  that  the  smugglers 
will  be  detected  ? 
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SAT  -  Behaviour  Simulation  Toolbox 


Chekwelp  26 

Gibsons  Schaltuucn  2? 


insh 

oastE 
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SAT  -  Behaviour  Simulation  Toolbox 


Opensteer  library 


^  SAT  Behaviour  Simulation  Toolbox 


Smuggling 

OVERLAYS  (press  FI  to  rotate):  none 

SMUGGLERS  Total:  6 
Number  running:  6 
Number  captured:  0 
Number  at  goal:  0 


average  speed:  47.09  km/h 
average  direction:  149.72  degrees 

Min  #  neighbors  per  smuggler:  1 
Matt  #  neighbors  per  smuggler:  3 
Avg  #  neighbors  per  smuggler:  1 .50 

Min  population  per  bin:  2 
Matt  population  per  bin:  4 
Avg  population  per  bin:  3.00 


update:  0.03406  (29fps) 
draw:  0.02892  (35  fps) 
other:  0.06819  (15  fps) 


Clock:  real-time  mode,  variable  frame  rate  (11  fps) 
Camera:  static 


SAT  -  Discretisation  Toolbox 


Chekwelp  26 
Gibsons  Scnaltuucn  27 

Bowen] 
floiven  lslaod 
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Navigation  graph 


SAT  -  The  State  Generation  Toolbox 


cast*  ul 

If  PosP=PosE  do  A 

If  Pos£e  Voismage(PoeP)  do  Mcve-to(pQsE) 
else  Move-to(n'importe  quel  nceud  adjacent) 
Observe 

end  case _ 


Context 


case  id 

if  FosP-PosE  do  A 

If  FosEe  Voisinage(PosP)  do  Move-tot  PosE) 
else  Move -tcKn'im porte  quel  nceud  adjacent  ) 
Observe 
end  case 


y 


p 


t  strategy 


■> 


State 

generator 


Situation 

(state  transition  system) 


Defence  R&D  Canada  •  R  &  D  pour  la  defense  Canada 


SAT  -  State  Searching  Toolbox 


Situation 


CTL  queries 


AX  0 

0  in  all  next  states. 

EX  0 

0  in  at  least  one  next  state. 

A  [(f)  U  tl)] 

on  all  paths,  0  until  0. 

E  [0  U  0] 

on  at  least  one  path,  0  until  0. 

AF  (f) 

On  all  paths,  in  some  future  state,  0. 

EF  0 

On  at  least  one  path,  in  some  future  state,  0. 

AG  0 

On  all  paths,  in  all  future  states,  0. 

EG  0 

On  at  least  one  path,  in  all  future  states,  0. 

Answer 
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f  \j)  SAT  -  Vizualisation  Toolbox 


□(is 


a 


Start:  (468665. 668974027,5471287. 136601858) 
Query  "EX  pursuitStateAUClear"  returned  false. 
Query  "EF  pursuitStateAUClear"  returned  false. 


(j>:  PursuitStateAUClear 

EX  <p:  (j)  in  at  least  one  next  state 

EF  (j):  On  at  least  one  path,  (j)  in  some  future  state 


CTL  query 


0 


Enter  a  CTL  query: 


AG  ~  pursuitStateAUClear 


OK 


Cancel 


-Qi 


/3 


Conclusions 


•  The  Situation  Analysis  Toolbox  (SAT)  implements  formal 
notions  of  situation  analysis  based  on  epistemic  state 
transition  systems. 

•  The  SAT  generates  situations  based  on 

1 .  an  abstract  version  of  the  environment  (visibility 
graph)  enriched  with  probability  maps  of  presence  of 
agents,  built  through  modeling  emerging  behaviour. 

2.  the  execution  of  a  joint  strategy  derived  from  pursuit- 
evasion  game  theory. 

•  The  SAT  analyses  the  situation  through  logical  queries. 

Further  works: 


Epistemic  and  probabilistic  queries 
Customise  to  account  for  other  applications 


SAT  -  Vizualizer 


Defence  R&D  Canada  •  R  &  D  pour  la  defense  Canada 


